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Abstract 



The present invention provides an analog signal synthesizing apparatus including a waveform memory for storing a plurality of 
analog signals as PCM data sampled with different sampling frequencies, the amount of PCM data corresponding to plural 
channels being read from the waveform memory and used to synthesize the analog signals. The analog signal synthesizing 
apparatus includes an oversampling device for shifting the sampling frequency of said PCM data read from said waveform 
memory for each channel toward the side of high frequency; a summing device for summing the oversampled PCM data for 
the respective channel; a D/A converter for converting the summed data into an analog signal; and a low-pass filter for setting 
a cut-off frequency based on the sampling frequency shifted to the side of high frequency and for eliminating aliasing noises 
included in the PCM data from the synthesized analog signal. The elimination of the aliasing noise included in the PCM data 
for each channel is carried out at the common low-pass filter. 
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© Apparatus for synthesizing analog signals In PCM. 



© The present invention provides an analog signal 
synthesizing apparatus including a waveform mem- 
ory for storing a plurality of analog signals as PCM 
data sampled with different sampling frequencies, 
the amount of PCM data corresponding to plural 
channels being read from the waveform memory and 
used to synthesize the analog signals. The analog 
signal synthesizing apparatus Includes an oversam- 
pllng device for shifting the sampling frequency of 
said PCM data read from said waveform memory for 
each channel toward the side of high frequency; a 

a summing device for summing the oversampled PCM 
d§ta for the respective channel; a D/A converter for 
converting the summed data into an analog signal; 
J§ and a low-pass filter for setting a cut-off frequency 
5j based on the sampling frequency shifted to the side 
of high frequency and for eliminating aliasing noises 
£j Included In the PCM data from the synthesized 
analog signal. The elimination of the aliasing noise 
included in the PCM data for each channel is carried 
^out at the common low-pass filter. 
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ANALOG SIGNAL SYNTHESIZER IN PCM 



BACKGROUND OF THE INVENTION 



Field of the Invention: 

The present invention relates to an analog sig- 
nal synthesizing system in PCM and more particu- 
larly to such a system capable of reading PCM 
data corresponding to plural channels from a 
waveform memory and synthesizing an analog sig- 
nal from such PCM data. 



Description of the Prior Art: 

PCM has various superior characteristics such 
as very high resistance to noise, very high resis- 
tance to interference with the adjacent channel and 
others. Therefore, PCM has been currently utilized 
in various broadly widened applications such as 
synthesizers, musical compact disc devices, PCM 
communication systems and others. 

Figure 8 shows the principle of PCM wherein it 
is supposed that an analog signal such as voice is 
converted into PCM signal. As shown in Figure 8A, 
an analog signal is sampled with a predetermined 
sampling frequency to form a PAM wave as shown 
in Figure 8B. Such a PAM wave is quantized and 
encoded to provide PCM data. 

If the PCM data so obtained are desired to re- 
convert into an analog signal, they are first de- 
coded to form the PAM wave as shown in Figure 
8B. The PAM wave is then passed through a low- 
pass filter to reproduce a signal wave having the 
original signal waveform. 

When the analog signal is sampled with the 
frequency f st there is obtained such a waveform 
spectra as shown in Rgure 9. In Figure 9, the 
hatched part is a spectra in the original analog 
signal. If such a sampling is carried out, there are 
created a plurality of aliasing noises at locations 
integer times the sampling frequency, that is, f s , 
2f 8) 3f s and so on. These aliasing noises will be 
superposed over the waveform spectra in the 
present signal if the sampling frequency f s is too 
low. Thus, it becomes impossible to faithfully re- 
produce the original analog signal. 

If the sampling frequency f 9 is too high, how- 
ever, the amount of data to be handled increases 
to make the data processing very cumbersome. 

In order to faithfully reproduce the original ana- 
log signal while minimizing the amount of data to 
be handled, thus, it is necessary to set the sam- 
pling frequency as low as possible within a range 



over which the aliasing noises are not mixed with 
the original signal. 

In accordance with the sampling theorem, the 
sampling frequency may be set at a level two 

5 times or more the maximum frequency in the origi- 
nal analog signal to prevent the waveform spectra 
thereof from being mixed with the aliasing noises. If 
the sampling frequency is set at a level two times 
the maximum frequency of an objective analog 

io signal, the amount of data to be handled can be 
minimized so that the original analog signal can be 
faithfully reproduced. 

Rgure 10 illustrates an example of the conven- 
tional analog signal synthesizing systems utilizing 

75 such PCM technique. 

Such a system comprises a waveform memory 
10 adapted to store a plurality of analog signals as 
PCM data which have been sampled with different 
sampling frequencies. PCM data corresponding to 

20 three channels are read out from the waveform 
memory 10 to synthesize an analog signal. 

For example, if the analog signal synthesizing 
system is to be used to produce a synthesized 
sound combining a plurality of musical instruments, 

25 voice analog signals from the objective musical 
instruments, for example, guitar, drums and bass 
are previously stored in the waveform memory 10 
as PCM data which are sampled with frequencies 
Uu f*2 and fs3 corresponding to those of the musl- 

30 cal instrument 

PCM data having the respective sampling fre- 
quencies f at , f s2 and fs3 are read from the waveform 
memory 10 through the first, second and third 
channels and converted into analog signals through 

35 D/A converters 12-1, 12-2 and 12-3. These analog 
signals are then inputted into low-pass filters 14-1, 
14-2 and 14-3, respectively. Aliasing noises are 
removed from the inputted analog signals by the 
respective low-pass filters 14-1, 14-2 and 14-3. 

40 Thereafter, the analog signals are applied to a 
mixer 18 through amplifiers 16-1, 16-2 and 16-3, 
respectively. At the mixer 18, the analog signals 
inputted thereinto and corresponding to three chan- 
nels are mixed to form a synthesized analog from 

45 the three analog signals, for example, a synthe- 
sized analog sound waveform consisting of the 
sound waves representative of the guitar, drums 
and bass. 

In order to use the low-pass filter 14 to remove 
so the aliasing noises included in the PCM data, it is 
necessary to set the cut-off frequencies f c in each 
of the low-pass filters 14-1, 14-2 and 14-3 at a level 
one-half the sampling frequency f s as shown in 
Figure 11A This is because if the cut-off frequency 
f c is higher than 1/2 f s as shown in Rgure 11B, a 
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part of the aliasing noises remains in the PCM data 
and will be reproduced as noises. 

As described hereinbefore, however, the PCM 
data read from the waveform memory through the 
first, second and third channels are different from 
one another in the sampling frequencies f s i, fg and 
f^. There is thus a problem that the low-pass filters 
14-1, 14-2 and 14-3 corresponding to the respec- 
tive channels must be set at different cut-off fre- 
quencies f c i. fc2 and fc3- 

!n particular, such a conventional system is 
designed such that the sampling frequency of the 
PCM data read out from the waveform memory 10 
is in one-to-one relationship with the cut-off fre- 
quency f c in the low-pass filter 14. Therefore, each 
of the channels is poor in universality. This takes 
place a problem in that the particular PCM data 
can be read out only from the corresponding chan- 
nel, for example, the sound of a guitar from the first 
channel, the sound of drums from the second 
channel and the sound of a bass from the third 
channel. 

When it is wanted to read many different PCM 
data, for example, ten or twenty different PCM data 
from the waveform memory 10, the number of 
channels corresponding to the number of the dif- 
ferent PCM data portions must be provided* This 
results in a further problem in that the entire con- 
struction of the system becomes costly and more 
complicated. 



SUMMARY OF THE INVENTION 



In view of the above problems of the prior art, 
it is an object of the present invention to provide an 
analog signal synthesizing system in PCM wherein 
the aliasing noises included in the PCM data for 
the respective channels can be removed through a 
common low-pass filter. 

To this end, the present invention provides an 
analog signal synthesizing system in PCM, com- 
prising a waveform memory for storing a plurality 
of analog signals as PCM data which are respec- 
tively sampled with different sampling frequencies, 
the PCM data corresponding to plural channels 
being read out from said waveform memory and 
used to synthesize an analog signal, the improve- 
ment being characterized in that said system com- 
prises: 

oversampling means for shifting the sampling fre- 
quency of the PCM data corresponding to each of 
the channels which is read out from the waveform 
memory toward the side of high frequency; 
adding means for summing the oversampled PCM 
data for each channel; 

D/A converting means for converting the summed 



data into an analog signal; and 
a common low-pass filter having a cut-off frequen- 
cy set based on the sampling frequency shifted 
toward the high frequency side, said common low- 

s pass filter being adapted to remove aliasing noises 
included in the PCM data from said synthesized 
analog signal. 

In such an arrangement, the waveform memory 
stores a plurality of analog signals as PCM data 

to which are sampled with different sampling frequen- 
cies. 

When the PCM data corresponding to each of 
the channels are read out from the waveform mem- 
ory, they are then oversampled. Such an oversam- 

rs pling process may be a process for determining 
new data utilizing, for example, various interpola- 
tions such as primary interpolation, secondary in- 
terpolation and so on. There is also a process of 
using the same data as those of the waveform 

20 memory for each oversampled point and digital 
filtering them as original data to determine new 
data. Such digital filtering processes include a fil- 
tering In the frequency region due to the discrete 
Fourier transformation (digital low-pass filter) or an- 

25 other filtering in time region fold in the impulse 
response of the filter (smoothing). The digital filter 
is more fully described in n Interface " p November 
1987, No. 126. 

On such an oversampling, the read-out PCM 

30 data corresponding to each of the channels will 
have its sampling frequency which is shifted toward 
the side of high frequency. 

It is now assumed that PCM data are read out 
from the waveform memory through each of the 

35 channels as shown in Figure 2A. When the PCM 
data so read out are oversampled as described, the 
sampling frequency f sl , f s2 or f^ corresponding to 
each of the channels will be shifted toward a higher 
frequency f D Ai. foA2 or f 0 A3. In such a manner, the 

40 present invention shifts any aliasing noise having 
its lower frequency included in the PCM data to- 
ward the region of higher frequency so that the 
spectra in the original signal as shown by hatching 
in Figure 2A are more broadly spaced away from 

45 the spectra of the adjacent aliasing noise. 

The oversampled PCM data for each channel 
are summed by adding means and converted into 
an analog signal through D/A converting means. 
Thereafter, the analog signal is applied to the low- 
so pass filter. As described hereinbefore, the low-pass 
filter has Its cut-off frequency set based on the 
sampling frequency shifted toward the higher fre- 
quency by the oversampling process, thereby re- 
moving any aliasing noise included in the PCM 

55 data from the input synthesized analog signal. 

In accordance with the present invention, thus, 
the PCM data corresponding to each of the chan- 
nels are oversampled to focedly shift the aliasing 
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noises having their lower frequencies toward the 
region of higher frequency. Therefore, the PCM 
data for each channel will have a widened spacing 
of frequency between the maximum frequency of 
the original signal and the minimum frequency of 
the aliasing noises. It is thus possible to set the 
same cut-off frequency of the low-pass filter for the 
PCM data corresponding to all the channels. 

In accordance with the present invention, fur- 
ther, the PCM data for the respective channels are 
summed to convert them into an analog signal 
which in turn is applied to a low-pass filter, rather 
than the provision of separate low-pass filters for 
the respective channels. Accordingly, the aliasing 
noises included in the PCM data for the respective 
channels can be removed by means of a common 
low-pass filter. This allows the entire construction 
of the system to be manufactured more simply and 
less costly. 

In accordance with the present Invention, fur- 
ther, the PCM data will not be limited to those read 
out from the waveform memory through each of 
the channels. For example, different PCM data can 
be read out from the waveform memory through 
the same channel. Thus, the signal synthesizing 
system according to the present invention is very 
high in universality for each channel. Even if PCM 
data in excess of the capacity corresponding to the 
number of channels are stored in the waveform 
memory, any PCM data combination can be op- 
tionally read out from the waveform memory 
through each of the channels to synthesize them 
into an analog signal. 



BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a circuit diagram of a preferred 
embodiment of an analog signal synthesizing sys- 
tem in PCM constructed according to the present 
invention. 

Figure 2 illustrates an example of oversam- 
pling; Rgure 2A shows the spectra of frequency in 
PCM data corresponding to each of the channels 
prior to the oversampling; and Rgure 2B shows the 
spectra of frequency after the oversampling. 

Rgure 3 is a block diagram of the entire 
construction of an analog signal synthesizing sys- 
tem to which the present invention is applied. 

Rgure 4 illustrates the memory map in the 
work memory shown in Rgure 3. 

Rgures 5 and 6 illustrate given areas in the 
memory map shown in Rgure 4B. 

Rgure 7 illustrates a linear interpolation. 



Rgure 8 Illustrates the conversion of an ana- 
log signal into a PCM signal; Rgure 8A shows the 
sampling of the analog signal with a predetermined 
frequency; and Rgure 8B illustrates the sampled 
s PAM wave. 

Figure 9 shows the spectra of frequency in 
the PCM data which are sampled with given sam- 
pling frequencies f s . 

Rgure 10 is a block diagram of a circuit 
to usable in the conventional analog signal synthesiz- 
. ing system in PCM. 

Rgure 11 illustrates cut-off frequencies for 
the PCM data; Rgure 11 A shows the sampling 
frequency set one-half the cut-off frequency; and 
75 Rgure 1 1B shows the sampling frequency set one- 
half higher than the cut-off frequency. 

DETAILED DESCRIPTION OF THE PREFERRED 
20 EMBODIMENT 



The present invention will now be described in 
connection with a preferred embodiment thereof 

25 illustrated in the drawings. 

Referring now to Rgure 3, there is shown an 
analog signal synthesizing system which is an pre- 
ferred embodiment of the present invention. 

The analog signal synthesizing system com- 

30 prises a waveform memory 10 which stores a plu- 
rality of voice signals (analog signals) as PCM data 
which are sampled with different sampling frequen- 
cies. PCM data corresponding to plural channels 
are read out from the waveform memory 10 and 

35 used to produce an output synthesized analog 
voice signal 100R for a right-hand speaker and an 
output synthesized analog voice signal 100L for a 
left-hand speaker. 

To this end, the system also comprises a work 

40 memory 20, a CPU 22 and a multi-channel prog- 
rammable sound synthesizer 24. 

The work memory 20 is provided with channel 
areas 0-23 addressed by addresses 0 - 17FH and 
interrupt areas addressed by addresses 1F8H - 

45 1FFH, as shown in Rgure 4A. The channel areas 
are so arranged as shown in Rgure 4B while the 
interrupt areas are so formed as shown in Rgure 
4C. 

The magnitudes of left- and right-hand sounds 
so in each of the channels are written in L-volume 
areas and R-volume areas for that channel as 
shown in Rgure 4B, respectively. Data representa- 
tive of the musical interval of a voice outputted 
through that channel are written in the frequency 
55 area thereof. Such flags as shown in Rgures 5 and 
6 are written in the flag area. At the start and end 
addresses, read-start and read-end addresses for 
the waveform memory 10 are respectively written 
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in the work memory 20. These read-start and read- 
end addresses are used to address PCM data to 
be read out from the waveform memory 10 through 
the corresponding channel. The repeat address In- 
cludes a repeat-start address written therein for 
repeatedly reading the addressed PCM data. 

CPU 22 is adapted to perform a computation of 
analog signal synthesization in accordance with an 
operational program with the result being applied to 
the multi-channel programmable sound synthesizer 
24 through the work memory 20. 

More particularly, the CPU 22 computes data 
to be written in each of the areas shown in Figure 
4A with the computed data being then written in 
the work memory 20. In addition, the CPU 22 
outputs various data required to read the PCM data 
from the waveform memory 10 through each of the 
channels 0-23, which data are then applied to the 
multi-channel programmable sound synthesizer 24. 

Figure 1 shows the circuit arrangement of the 
multi-channel programmable sound synthesizer 24. 

The synthesizer 24 comprises a control circuit 
30 for reading the PCM data from the waveform 
memory 10 for each channel, based on both the 
data outputted from the CPU 22 and the data 
written in the work memory 20; and an oversam- 
pling circuit 32 for oversampling the PCM data 
read out from the waveform memory 10 for each 
channel. 

The control circuit 30 is adapted to sequentially 
output reading-out addresses for the PCM data 
from the respective channels 0-23 toward the 
waveform memory 10 using the time sharing pro- 
cess. Thus, the PCM data for each channel are 
addressed by the corresponding reading-out ad- 
dress and sequentially read out from the waveform 
memory 10. The PCM data so read are then ap- 
plied to the oversampling circuit 32. 

If the musical interval Is set higher, the control 
circuit 30 will increment the PCM data reading-out 
address at a shortened time interval. If the musical 
interval is set lower, the control circuit 30 will 
increment the reading-out address at a prolonged 
time interval. 

At the same time, the control circuit 30 outputs 
frequency data 120 representing the musical inter- 
val of the read PCM data toward the oversampling 
circuit 32 while outputting volume data 130R and 
130L indicating the right- and left-hand volumes 
toward multipliers 46R and 46L, respectively. 

The oversampling circuit 32 is adapted to over- 
sample the PCM data read out from the waveform 
memory to for each channel so that the sampling 
frequency of the read PCM data will be shifted 
toward the side of higher frequency. 

The oversampling may be accomplished by 
using any suitable process such as primary inter- 
polation (linear interpolation), secondary interpola- 



tion, digital filtering or the like. In the illustrated 
embodiment the PCM data is processed by using 
the linear interpolation such that they will be shifted 
toward the side of higher frequency. 

5 It is now assumed that PCM data for a channel 
are read out from the waveform memory 10 in the 
order of H^, H n and so on as shown In Figure 7. In 
such a case, the m-th interpolation data H between 
the PCM data H„.i and H n can be determined as 

w follows (m - 0, 1 ): 

H = + Ah 

= + (A H/AT) mAt 

a Hn-i + (H n - H„.i) mAt/ AT (1) 

where A T = T n • T fr1 ; and each of T^ t T n ... 

75 represents time at which the PCM data for each 
channel are outputted from the waveform memory 
10. 

When one of the interpolation data between the 
PCM data H n . t and H n is determined by such a 

20 linear interpolation equation, the sampling frequen- 
cy f 8 of the PCM data read out from the waveform 
memory 10 can be shifted toward the side of 
higher frequency by two times the sampling fre- 
quency, that is, up to 2f s . If two of the interpolation 

25 data between the PCM data are determined, the 
sampling frequency can substantially be increased 
up to three times. 

As seen from Figure 1 , the PCM data read out 
from the waveform memory 10 at this time are 12 

30 bits, the data outputted from a subtracter 36 are 13 
bits and the data outputted from a frequency data 
memory 40 are 8 bits. These data are computed at 
multiplier 38 and adder 44 for interpolation. The 
resulting PCM data will be extended to 16 bits with 

35 its resolution being increased. 

For the linear interpolation, the oversampling 
circuit 32 comprises a latch circuit 34, the subtrac- 
ter 36, the multiplier 38, the frequency data mem- 
ory 40, a frequency data adder 42 and an adder 

40 44. 

The PCM data H n read out from the waveform 
memory 10 are applied to the latch circuit 34 and 
the subtracter 36. 

The latch circuit 34 is adapted to output the 
45 previously inputted PCM data toward the sub- 
tractor 36 and adder 44. From the PCM data H n 
and H fr1 thus inputted, the subtracter 36 computes 
A H = H n - Hno which in turn is applied to the 
adder 38. 

so The frequency data memory 40 receives an 
initial value (At/AT) from the control circuit 30 as 
frequency data representative of the musical inter- 
val of the PCM data. The frequency data adder 42 
utilizes this initial value (At/AT) to compute m( 

55 At/AT) which in turn is applied to the multiplier 38. 

Based on the data so inputted, the multiplier 38 
computes Ah = ( A H/AT) mAt which in turn is 
applied to the adder 44. 
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The adder 44 totalizes the data thus inputted 
therein to compute the linear interpolation data H 
shown in the equation (1), which in turn are applied 
to the multipliers 46R and 46L 

Each of the multipliers 46R and 46L multiplies 
the PCM data from the oversampling circuit 32 by 
the right- or left-hand data 130R or 130L with the 
result being then applied to the corresponding one 
of right-channel and left-channel accumulators 48R 
and 48L 

The multi-channel programmable sound syn- 
thesizer 24 is adapted to repeat the aforemen- 
tioned computation for all the channels 0 - 23 using 
the time sharing process. The computed data cor- 
responding to all the channels 0 - 23 are sequen- 
tially accumulated at the accumulators 48R and 
48L 

If the PCM data for the 23-th channel have 
been accumulated, the accumulated values in the 
right- and left-channel accumulators 48R and 48L 
are then applied sequentially to a shift register 52 
through a multiplexer 50. The multiplexer 50 then 
converts the accumulated values for the left- and 
right-channels into serial data which In turn are 
outputted therefrom. These serial data are then 
applied to a D/A converter 62 through a serial- 
parallel converting circuit 60 shown in Figure 3. 

The conversion of the accumulated values into 
the serial data is performed since the synthesizer 
24 of the illustrated embodiment is in the form of a 
serial data output type one-chip element which 
requires the reduced number of output pins. On the 
contrary, if the synthesizer 24 is in the form of a 
parallel data output type one-chip element having 
the increased number of output pins, the mul- 
tiplexer 50, shift register 52 and serial-parallel con- 
verting circuit 60 may be omitted. 

After the accumulated values for the right- and 
left-channels have been inputted in the D/A con- 
verter 62 through the serial-parallel converting cir- 
cuit 60, they are converted into analog signals 
thereat which In turn are applied to the right-and 
left-channel low-pass filters 64R and 64L, respec- 
tively. 

Each of the low-pass filters 64R and 64L has 
its own cut-off frequency f 0 set based on the cor- 
responding sampling frequency which has been 
shifted to the side of higher frequency. As a result, 
any aliasing noise included the PCM data may be 
removed from the analog signals Inputted therein. 
The analog signals are then outputted therefrom 
through amplifiers 66R and 66L as voice signals 
100R and 100L for right- and left-hand channels. 

The operation of such an arrangement will be 
described below: 

The signal synthesizing system of the illus- 
trated embodiment is adapted to sequentially read 
PCM data from the waveform memory 10 for each 



of the channels 0 - 23 through the time sharing 
process. 

Figure 2A shows the spectra of frequency in 
the PCM data read out from the waveform memory 

5 10 for the respective channels. As described 
hereinbefore, the PCM data have its sampling fre- 
quency f s which has been shifted to two times the 
maximum frequency of the original analog signal. 
Therefore, the PCM data read out from the 

70 waveform memory 10 through each of the channels 
will include the spectrum of the original signal 
shown by hatching which is created in close prox- 
imity to the spectrum of the aliasing noise. If there 
is not set a cut-off frequency f c inherent in each of 

75 the channels, no aliasing noise can be removed 
reliably from the PCM data 

On the contrary, the analog signal synthesizing 
system of the present Invention comprises the 
oversampling circuit 32 for appropriately process- 

20 ing the PCM data read out from the waveform 
memory 10 for each channel so that the sampling 
frequency of the PCM data for each channel will be 
shifted to the side of higher frequency as shown in 
Figure 2B. 

25 In other words, the illustrated embodiment is 
adapted to determine the data H between the adja- 
cent PCM data and H„ by means of the linear 
interpolation, as shown in Figure 7. Therefore, the 
rows of data having tower sampling frequencies 

30 shown in Figure 2A can be converted into the other 
rows of data which are assumed that they are 
sampled with higher frequencies f D Ai such that the 
apparent sampling frequency foA in the data row for 
each channel will be forcedly shifted to the side of 

35 higher frequency. 

At this time, if one of the PCM interpolated 
data H is determined between the adjacent PCM 
data, the apparent sampling frequency can be in- 
creased up to two times. If interpolated data H of n 

40 in number (n is an integer) are determined between 
the respective adjacent PCM data, the apparent 
sampling frequency f 0 A can be increased up to 
(n + 1) times the sampling frequency f 8 . 

By thus shifting the apparent sampling fre- 

45 quency foA of the PCM data read out from the 
waveform memory 10 through each channel toward 
the side of higher frequency, the aliasing noises 
having lower frequencies for each channel can be 
forcedly shifted toward the side of higher frequency 

so so that the spacing of frequency between the origi- 
nal signal and any aliasing noise will be expanded. 

Even if the oversampled PCM data for each 
channel are synthesized by the use of the accu- 
mulators 48R and 48L, therefore, the original signal 

55 included in the synthesized PCM data will be over- 
lapped by any aliasing noise with the spacing of 
frequency therebetween becoming sufficient. 

In this connection, the sampling frequencies of 
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FIG . 2 A 
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FIG. 6 
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FIG. 8 A 
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